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Abstract 

We analyze the asymptotic behavior for a system of fully nonlinear parabolic and 
elliptic quasi variational inequalities. These equations are related to robust switching 
control problems introduced in .Jj- We prove that, as time horizon goes to infinity 
(resp. discount factor goes to zero) the long run average solution to the parabolic 
system (resp. the limiting discounted solution to the elliptic system) is characterized 
by a solution of a nonlinear system of ergodic variational inequalities. Our results hold 
under a dissipativity condition and without any non degeneracy assumption on the 
diffusion term. Our approach uses mainly probabilistic arguments and in particular 
a dual randomized game representation for the solution to the system of variational 
inequalities. 
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1 Introduction 


Let us consider the following system of forward parabolic quasi variational inequalities 
r dV 

min l dT ~ infttef/ \°' uv + /V, *, «)], 

( V(T,x,i) - maxj^j [V(T,x, j) - c(x,i, j)] j = 0, (T, x, i) £ (0, oo) x x I m , (l- 1 ) 
V(0,x,i) = g(x,i ), (x, i) € l d x I m , 

where I m m}, with m £ N\{0}, and C l,u is the second-order differential operator 


C’ U V = b(x, i, u).D x V + -tr(cnr T (x, i, u)D^V). 

Here U is a compact subset of M 9 , and the assumptions on the measurable functions b,a, 
c, f and g will be made precise in the next section. Equation (11.11) turns out to be related 
to a certain robust switching control problem studied in [3j: 


V(T,x,i) 


sup inf E x i 

a v 



I t ,v t )dt +g(X T ,I T ) 


y! c (X Tn > I T ~ 5 It„ ) 1 {r n <T} ) 
neN 


( 1 . 2 ) 


where 

{x t = x + fo b(X r , I r ,v r )dr + a(X r ,I r , v r )dW r , 

O* = *^{0<t<r 0 } + SngN i n^-{T n <t<T n+1 }- 

The piecewise constant process I denotes the regime value at time t, whose evolution 
is determined by the controller through the switching control a = (r n , i n ) n , while the 
process v, decided by nature, brings the uncertainty within the dynamics of state process 
X and the model. The control process sets in which a and v run over is a key issue when 
considering stochastic differential game type problems as in the formulation (11.21) . In the 
robust switching control problem, the switching control a is of feedback form, meaning that 
it is chosen by the controller based only on the past and present information coming from 
the state and regime processes, while the control v is more generally of open-loop form, 
since nature is assumed to be aware of all information at disposal. Precise formulation 
of robust switching problem is given in Section 13.11 Also see [3], where we proved by 
developing stochastic Perron’s method (which was introduced in [3] to analyze stochastic 
control problems) further that the value function V in (11.21) is the unique viscosity solution 
to (O). The corresponding elliptic system of quasi variational inequalities for any /3 > 0 
is 


mm 


{/ 3 V 3 


- inf [C X ' U V P + f{x,i,u)],V?{x,i) - max [V^x, j) -c(x,i,j)]\ = 0, (1.3) 

u£U j^i J 


for any (x,i) £ M d x I m . Similar to the parabolic case, this system is related to a robust 
switching control problem but this time over an infinite horizon with discount factor /3. 

The chief goal of this paper is to investigate the large time asymptotics of V(T, .) as 
T goes to infinity, which is closely related to the asymptotic behavior of V 3 , as (3 goes 
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to zero. Asymptotics for stochastic control and related Hamilton-Jacobi-Bellman (HJB) 
equations have been studied in various settings by many authors since the seminal papers 
[5] and [I], and has received a renewed interest, see the lectures of P.L. Lions (2014-2015) 
at College de France. Recent papers include for instance [8j, which studied large time 
behavior for viscous and non-viscous Hamilton-Jacobi equations, m for the long time 
behavior of Hamilton-Hacobi equations in a semi-periodic setting, or [22], which considered 
large time behavior of semi-linear HJB equations with quadratic nonlinearity in gradients 
by combining PDE and stochastic analysis methods. We mention also EL which proved 
a rate of convergence for the solution to the semi-linear HJB equation towards the ergodic 
equation under a weak dissipativity condition. The case of fully nonlinear HJB equation 
is studied recently in [6] by means of backward stochastic differential equation (BSDE) 
representation for nonlinear parabolic, elliptic and ergodic equations. The case of (quasi) 
variational inequalities arising from switching control problems so far only received limited 
attention, except for the papers [T8] and m- We introduce three novel features to this 
problem: First, we consider diffusion coefficients b, and a depending not only on the state 
process x but also on the regime values i; second, we incorporate robustness in our model 
by considering dependence of the diffusion coefficients on the open loop control v. From a 
PDE point of view, this makes the problem fully nonlinear due to the infimum over u € U 
in (D). Third, we do not impose a non-degeneracy condition on the diffusion term. 

Our main result is to prove, under natural dissipativity conditions, the existence of a 
constant A (not depending on state and regime values x,i ) such that 


T^o A _ ««+ Ai 


(1.4) 


for all (x,i) € M d x I m . Moreover, A is the solution to the ergodic system of variational 
inequalities: 

min < A — inf \C' U <$> + f(x, i, rt)l, </>(x, i) — max \<p{x,j) — c(x, i, j)] > = 0. (1.5) 

l u£U J J 


Here the unknown in the ergodic equation (11.51) is the pair (A, 4>) with A real number, and 
i j) a real-valued function on R d x I m . In the proof of the ergodic convergence (11.41) . a crucial 
step is the derivation of a uniform (in j3) Lipschitz estimate on , and so the equicontinuity 
of the family ( V^)p . The main difficulty in our context, with respect to previous related 
works, is that we do not in general have any regularity on the solution V 13 to (|1.3I) . We 
also cannot rely on the analog of the robust switching control representation (11.21) for the 
infinite horizon problem. Indeed, because of the feedback form on the switching control 
a, which may then depend on the initial state value, it is not clear how to get suitable 
Lipschitz properties of V 13 , see Section I4~T1 for a more detailed discussion. To overcome 
this issue, we instead provide a dual probabilistic game representation of V@ based on 
randomization of the controls a and v, and following the idea originally developed in m 
and El for stochastic control problem. This representation then allows us to derive the 
needed Lipschitz estimate for . 

The rest of the paper is organized as follows. Section [2] sets the assumptions and formu¬ 
lates the main results. We recall in Section [3] the connection between the parabolic system 
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of quasi variational inequalities (11.11) and robust switching control problem as studied in 
[3j, and shows by a simple probabilistic control representation argument (which seems to 
be new to the best of our knowledge) the long run average convergence of the solution to 
the parabolic system to a solution of the ergodic system when it exists. Section [4] is the 
core of the paper, and is devoted to the existence of a solution to the ergodic system as 
well as the convergence of the limiting discounted solution to the elliptic system. The main 
point is to state a dual representation for V&. This is achieved by using a randomization 
approach and a BSDE representation for the penalized solution E /3,n to the elliptic system 
of variational inequalities, which then permits to derive a dual representation for E^ ,n , and 
consequently for , and then to obtain the key estimates for . Finally, some technical 
results are deferred to the Appendix. 

2 Formulation of the problem and main results 

2.1 Notation and assumptions 

Let U be a compact subset of a Euclidean space K 9 and I m := (1,..., m}, with m € N\{0}. 
We begin imposing the following assumptions on the coefficients of the system of parabolic 
and elliptic quasi variational inequalities m and (H^D- 

CHi) 

(i) b: M d x I m x U —>• W 1 and a: M d x I m x U —>■ M. dxd are continuous and satisfy (we 
denote by ||A|| = ydr {AA*) the Frobenius norm of any matrix A)\ 

\b(x,i,u) — b(x',i,u)\ + \\cr(x,i,u) — <j(x', i,u)\\ < L\\x — x'\, 

Vs, x' £ M . d , i £ I m , u£U, for some positive constant L\. 

(ii) f: M. d x I m x U —» M, g: M 0 * x I m —>• M, and c: x I m x I m M are continuous and 

satisfy 

\f(x,i,u) - f(x',i,u)\ + \c(x,i,j) - c(x',i,j)\ < L 2 \x - x'\, 

\g(x,i) | < M 2 (1 + |x| 2 ), 

Vs,s' £ M. d , i,j £ I m , u £ U, for some positive constants L 2 and M 2 . 

(iii) g satisfies the inequality 

g{x,i) > ma x[g(x,j)-c(i,j)\, 

Vs € i £ I m . 

(iv) c is nonnegative and the no free loop property holds: for all d, ••■,*& £ Im, with 
k £ N\{0,1, 2}, i] = ik, and card{d,..., ik} = k — 1, we have 

c(x, ii,i 2 ) + c(x, i 2 , i 3 ) H- c(x,i k -i,ik) + c(x,i k ,h) >0, Vs£l d . 

Moreover, we suppose that c(x, i, i) = 0, V (x, i) £ x I m . 
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We also impose the following dissipativity condition. 

(H2) For all x,x' G i G I m , u GU, 

(x — x').(b(x,i,u) — b(x',i,u)) +-\\a(x,i,u) — a(x',i,u)\\ 2 < —7 |x — a/| 2 , (2.1) 

for some constant 7 > 0 . 

Remark 2.1 Equation (11.11) (and similarly (11.31) 1 turns out to be related to a certain 
robust switching control problem studied in [3], as explained in Section PTTl below (see 
also Section HU). For this reason, the set of assumptions (HI) is the same as in [3], 
but for some additional requirements needed to obtain a backward stochastic differential 
equation representation (first presented in [T7j for the case of a classical stochastic control 
problem) and for the polynomial growth condition on g, which in [3] is not necessarily of 
second degree. This latter assumption plays an important role since it allows to exploit an 
estimate on the second moment of the state process (reported in Lemma 13.21 belowl. which 
follows from the dissipativity condition (H2). □ 

2.2 Main results 

Consider the following ergodic system of quasi variational inequalities 

minjA — inf \C l,u (j)(x, i) + f(x, i, it)], 4>(x, i) — max \<f(x, j) — c(x, i, j)] } = 0. ( 2 . 2 ) 

l u€U j^i J J 

We begin providing the definition of viscosity solution to system (12.21) . 

Definition 2.1 (i) We say that a pair (A with A G R and cf: W l x I m — > R a lower 
( resp. upper) semicontinuous function, is a viscosity supersolution ( resp. subsolution ) to 
the system of variational inequalities m */ 

min < A - inf \C. l,u ip(x, i) + fix, i, u) 1, (fix, i) — max \(f(x,j) — cix , i,j)] > > (resp. <) 0, 
l uGU j^i J 

for any (x,i) G x I m and any G C 2 (M d ) such that 

4>(x,i) - tp(x) = min{(f(-,i) - </?(•)} (resp. max{ 0 (-, i) - <£>(■)}). 

R d V R d 

(ii) We say that a pair (\,4>), with A G R and (j>: M d x I m M a continuous function, is 
a viscosity solution to the system of variational inequalities ( 12 . 21 ) if it is both a viscosity 
supersolution and a viscosity subsolution to (| 2 . 2 p . 

We can now summarize the main results of the paper in the two following theorems. 
Theorem 2.1 Suppose that Assumption (HI) holds. 

(i) There exists a unique continuous viscosity solution V to system (EH) satisfying the 
growth condition: for any T > 0, there exist Ct > 0 and qr > 1 such that 

\V(t,x,i)\ < C T (l + \x\ qT ), 
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for all ( t,x,i ) G [0, T] xl d xl m . 

(ii) If in addition Assumption (H2) holds, then, for any (3 > 0, there exists a unique 
continuous viscosity solution V 13 to system (11.31) satisfying the linear growth condition: 
there exists Cp > 0 such that 

\V p (x,i)\ < Cp(l + \x\), 

for all ( x,i ) G x I m . 

For the next result, we need the following additional assumptions. 

(H3) The cost function c is constant with respect to the variable x G M rf . By an 
abuse of notation, under Assumption (H3), we denote c(i,j) = c(x,i,j), for all ( x,i,j) G 
K d x I m x I m . 

(HI/) The interior set U of U is connected, and U coincides with the closure of its 
interior: U = Cl(f7). 

Remark 2.2 (i) Assumption (H3) is standard in the literature on switching control pro¬ 
blems. In the present paper, it is used in Propositions 14.31 and 14.41 (and also in Corollary 
I4.2( i)) to establish the crucial uniform Lipschitz property of V^ with respect to x. 

(ii) Assumption (HI/) is employed in obtaining a dual representation formula for V' d in 
Proposition 14.41 □ 


Theorem 2.2 Let Assumptions (HI), (H2), (H3), and (H U) hold. Then, there exists 
a viscosity solution (X,cj>), with cj>(-,i) Lipschitz, for any i G I m , and </>(0,*o) = 0 for some 
fixed *o G I m , to the ergodic system m, such that 

/ 3V p {x,i ) A, 

for all (x,i) G x I m , and, for some sequence (/3k)keN> Pk \ 0 + , we have 

Vh(;i)-Vh(0,io) (/)(-, i), 

in C(R d ) 

for all i G I m , where “in C(M d )” stands for uniform convergence on compact subsets ofM. d . 
Moreover, for any viscosity solution (A,</>) to (12.21) . with <f satisfying 

\cf(x,i)\ < M^{l + \x\ 2 ), V (x, i) £ R d x I m , (2.3) 


for some constants > 0 , we have 

V(T, x, i) t-> oo 


V (x, i) G l d x I m . 


In particular, A is uniquely determined for all viscosity solutions (X,cj>) to (12.21) . with (f> 
satisfying a quadratic growth condition as in (& 
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Remark 2.3 (i) A question which naturally arises from Theorem 12.21 is the uniqueness of 
cj). This problem has been tackled in |6j, Theorem 5.2, using probabilistic techniques as in 
[1~2 and assuming some smoothness of together with the existence of an optimal feedback 
control (under which the state process admits a unique invariant measure). This kind 
of proof seems, however, designed to deal with ergodic equation associated to stochastic 
control problems rather than to stochastic differential games. Let us explain more in detail 
this latter issue, recalling the main steps of the proof of Theorem 5.2 in [6] (translated into 
the present framework) and emphasizing where it breaks down for stochastic differential 
games. The goal in consists in proving, for every i £ I m , that there exists a real constant 
Ci such that 

W(T,x,i) := V(T,x,i)-(\T + <i>(x,i)) 1 C h V(x, i) £ R d x I m . (2.4) 


We see that if (12.41) holds for every viscosity solution (A, c p), with cj) Lipschitz, to the ergodic 
system (12.2|) . then, for every i £ I m , <j>(-,i) is uniquely determined up to a constant which 
depends only on i £ I m . To prove (j2.4[> . we proceed as follows (we just sketch the main 
steps and do not pause on the technicalities, however we use some results from Section [3] 
below). For any T,S > 0, from the identity V(T + S, x. i ) = l/ T+5 (0, x, i ,) stated in (|3.9|) . 
we deduce 


V(T + S, x, i ) = sup inf E 

aeAo,o v&u o,o L Jo 


f( X %’ x * a > v , jO,x,r,a,v^ + y( Sj , jO,x,i-,a,Vj 

E h<T} • 


nGN 


On the other hand, from (|3.15l) with t = 0, we have 

r T 


(j)(x, i ) = sup inf E 
aeA 0 , 0 v ^ u o,o 


{f(X%’ x ’ i '’ a ’ v ,I^ a ’ v , Vs ) - A )ds + (j){X^ x ’ i ’ a ’ v ,I^ a ’ v ) 
E c(X°r?’ inV , I*?**’, Ir"- a ' V )i(r,<T) ■ 


nGN 


Now, suppose that there exists an optimal control a* = (r*,i*) ne ^ € Ao,o, independent of 
T, such that 


<t>(x,i) = inf E 

vGUq o 


'0 




E c < x 


0 ,x,i;a*,v j-0,x,i;a* ,v r0 ,x,i;a*,v 


«) 


r 

’ r, 


)i 


{«T} 


nGN 


As a consequence, we obtain the inequality 

W(T + S,x,i) > inf E\W(S,X% x ’ i]a *’ v ,I % x ’ i ’ a *’ v )]. (2.5) 

v£U 0 ,o 

As in [6] and m, let us introduce, for any i £ I m , the set of w-limits of {W(T, -,z)}t>o in 
C(R d ): 


Tj := {Woo €= C(R d ): w(Tj, ■,i ) —»• in C(M d ) for some Tj oo}. 
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It can be shown that Fj / 0. Therefore, (12.41) follows if we prove that F, = {(Coe,*} is 
a singleton, with w 00 j constant. In [6j, Theorem 5.2, the idea is to pass to the limit in 
(12.51) . using that under a* the state process admits a unique invariant measure. Since, 
however, in (12.51) there is also the “inf” operator (due to the game feature of the robust 
switching control problem), the same argument does not allow to conclude (indeed, e.g., 
the “invariant measure” would depend on v £ Uq$). 

(ii) Notice that A appearing in Theorem 12.21 does not depend on i £ I m . 

(iii) Assumptions (H3) and (HI/) in Theorem 12.21 are not needed to prove the convergence 
results of V, but only them of V@. 

(iv) Theorem 12.21 can be interpreted as a Tauberian theorem. Indeed, the convergence 

results for V 13 allows to prove the existence of a viscosity solution (A, (j>) to (12.21) . from 
which the asymptotic results for V follow (see also Remark 5.3(h) in 0). □ 

The rest of the paper is devoted not only to the proof of Theorems 12.11 and 12.21 but 
also to investigate more in detail the properties of the systems (jl.ll) . (|1.3I) . and (|2.2I) . in 
particular from a stochastic control point of view, exploring their relation with robust 
switching control problems. To sum up, the logical flow of the paper is the following: 
Section [3] is devoted to the analysis of the parabolic system. The essence of this section are 
three propositions: Proposition 13.11 states the connection between the parabolic system of 
variational inequalities <o> and robust switching control problem. Proposition 13.21 gives 
robust control representation bounds for a solution to the ergodic system, which together 
with Proposition 13.11 leads to a quite simple argument for proving in Proposition 13.31 the 
long time convergence of the parabolic system. In Section [4l we analyze the elliptic system. 
The essence of this section can be summarized as follows. Proposition 14.21 provides a 
Feynman-Kac formula in terms of BSDE for the solution V^ ,n to the penalized system 
of elliptic variational inequalities, which is then used for stating in Corollary 14.11 a dual 
representation for V^' n , and then by passing to the limit in n, for getting in Proposition 
K3\ a dual probabilistic game representation for V 3 . From these dual representations, we 
are able to derive key uniform estimates for V^' n in Corollary 14.21 and then for V 13 in 
Propositions 14.31 and 14.41 Finally, we can obtain the existence of a solution to the ergodic 
system and the convergence result of V and V 13 in Proposition 14.51 

3 Long time asymptotics of the parabolic system 

We firstly investigate the long time asymptotics of the solution V to the parabolic system of 
variational inequalities (11.11) . To this end, we shall rely on probabilistic arguments, which 
are based on a characterization of V in terms of a finite horizon robust switching control 
problem introduced in [3], that we now describe. 

3.1 Robust feedback switching control problem 

We present the robust switching control problem focusing only on the main issues, in order 
to alleviate the presentation and reduce as much as possible the technicalities, for which 
we refer to [3j. 
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Consider a complete probability space (17, J 7 , P) and a d-dimensional Brownian motion 
W = (Wt)t> o defined on it. Denote by P = (J r t)t>o the completion of the natural filtration 
generated by W. Fix a finite time horizon T G (0, oo). In the robust switching control 
problem we are going to present, the switcher plays against an adverse player, which can 
be interpreted as nature and renders the optimization problem robust. We begin recalling 
the type of controls adopted by the switcher and by nature, following Definitions 2.1 and 
2.2 in [3], to which we refer for more details: 

• At t t■ t € [ 0 , T], denotes the family of all feedback switching controls starting at time 
t for the switcher. A generic element of Att is given by a double sequence a = 
CbiDrOraeNj where (r n ) nS N is a nondecreasing sequence of stopping times valued in 
[t, T] and t n € I m represents the switching action, i.e., the regime from time r n up 
to time r n _|_i. The random variable t n only depends on the information known up to 
time T n - Each a has a feedback form, in the sense that it is chosen by the switcher 
based only on the past and present information coming from the state and regime 
processes. 

• Ut,u t G [0, T], denotes the family of all open-loop controls starting at time t for 
nature. A generic element of U^t is an adapted process v : [t, T] x 17 — > U. 

As explained in [3], the reason behind the feedback form of a switching control comes from 
the observation that the switcher in general knows only the evolution of the state process 
X and regime I. On the other hand, a control v G Ut,t is not necessarily of feedback form, 
since nature at time t G [0, T] is wise to all information up to time t. 

Let us now introduce the controlled dynamics of the state and regime processes. For 
any ( t,x,i ) G [0, T] x R d x I m , a = ( r n ,i n ) ne n £ At,t, v £ hlt,ti the state process X and 
regime I evolve on [t,T] according to the following controlled SDEs: 

X s = x + f t s b(X r , I r ,v r )dr + f t & cr(X r , I r ,v r )dW r , t < s <T, 

< I s — il-{t<s<To(X.,I _)} T XmeN I. )l{r n (A'.,/ _)<s<T n+ i(X,/._)}> t < S < T, 

I T = I T - 1 

(3.1) 

with I t - := I t . Notice that T n and t n have a feedback form, indeed they depends only on 
X and I. We recall the following wellposedness result from [3j. 


Lemma 3.1 Suppose that Assumption (HI) holds. For any T > 0, (7, x, i ) G [0, T] x R* 1 x 
Im, a G Atg, v G Idt.t, there exists a unique (up to indistinguishability) F -adapted process 
(X t ’ x ’ v ’ a ’ v ,I t ’ x ’ v ’ a ’ v ') = [xl’ x,t,a ’ v , I t s X,l,a,v )t< s <T to equation (13.11) . Moreover, for any p > 2 
there exists a positive constant C Py T, depending only onp,T,L\ (independent oft,x,i,a,v), 
such that 


E 


sup | X t a ’ x * a ' v \P < C PtT (l + \x\ p ). 

t<s<T 1 


(3.2) 


Proof. See Proposition 2.1 in |3]. 

We also have the following result as a consequence of the dissipativity condition. 


□ 
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Lemma 3.2 Suppose that Assumptions (HI) and (H2) hold. There exists a positive con¬ 
stant C, depending only on := sup^ u ' )e i rnXU (\b(0,i,u)\ + \\(j(0,i,u)\\), L\, and'y, such 
that 


sup 

s£[t,T],a£At,t,v£U t ,t 


E [| x t,x,i-,a,v^ 


< C{ 1 + |x| 2 ), 


(3.3) 


for any (t, x, i) £ [0, T) x x I m and T > 0. 

Proof. Fix T > 0, ( t,x,i ) £ [0,T] x x I m , a £ At,t, v £ Ut,t- The proof can be 
done along the lines of Lemma 2.1 (i) in [ 6 ]. We simply recall the main steps. We take 
s £ [t,T] and apply Ito’s formula to e i( r - t )\Xr X,l ' a ’ v \ 2 between r = t and r = s. Then, we 
rearrange the terms in order to exploit the dissipativity condition (H2). Afterwards, using 
the uniform linear growth condition of h and a with respect to x, we find that there exists 
a constant C , depending only on M& >(T , Li, 7 , such that 


I yt,X)i\OL,v |2 


< C(l + \x\ 2 + 


el {r-s) ( X t,x,i;a,vy a ( X t,x,r,a,v, ^ v y dW \ . ( 3 . 4 ) 


From estimate (13.21) and the linear growth of a, we see that the stochastic integral in (13.41) 
is a martingale. Therefore, taking the expectation in (13.41) . the claim follows. □ 


We can now introduce the value function of the robust feedback switching control prob¬ 
lem, which is given by: 


V T (t,x,i) '■= sup inf J T (t,x,i',a,v), 
aeAt.t 


V (t, x , i) £ [0, T] x R d x I m , (3.5) 


with 


J T (t, x, i; a, v) : = E 


/( X AM;«,v, Vg } ds + g ( X 


ne N 


t,x,i;a,v -rt,x,v,a,v 


T 

, lrjy 


where r n stands for T n (x s,x, ‘ l ' a ’ v , I s -Notice that the presence of the inf, je ^ M in 
(13.51) means that we are looking at the worst case scenario for the switcher and makes the 
switching control problem robust. 

The dynamic programming equation associated to the robust switching control problem 
is given by the following system of backward parabolic variational inequalities: 

' j- QyT 

min |- —{t,x,i) -inf ueU [£ l ’ u V T (t,x,i) + f(x,i,u)\, 

* V T (t,x,i) - max^j [V T (t,x,j) - c(x,i, j)] } = 0 , (f, x, i) £ [ 0 , T) x R d x I m ,( 3 - 6 ) 

V T (T,x,i ) = (x, i) £ x I m . 


In Corollary 4.1 of [3j it is proved, by means of the stochastic Perron method, that V T sat¬ 
isfies the dynamic programming principle and it is the unique continuous viscosity solution 
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to system (13.611 (see Definition 2.3 in [3] for the definition of viscosity solution to (13.61) 1. 
satisfying a polynomial growth condition 


sup 

(t,a;,i)G[0,T] xR d xI m 


\V T (t, x, i)\ 

1 + Ixl 9 


< oo, 


(3.7) 


for some q > 1. 


We can now present the relation between system (11.11) and the robust switching control 
problem, which also gives a wellposedness result for viscosity solutions to ed (we do not 
recall here the definition of viscosity solution to ed, since it is standard and similar to 
the definition of viscosity solution to ()3.6|) . for which we refer to Definition 2.3 in f3j). 


Proposition 3.1 Suppose that Assumption (HI) holds. Then, there exists a unique con¬ 
tinuous viscosity solution V to system (ED satisfying the growth condition: for any T > 0, 
there exist Ct > 0 and qT > 1 such that 

\V(t,x,i)\ < C T { l + |*r), (3.8) 

for all ( t,x,i ) € [0, T] xR d xl m . The function V is given by 

V(t,x,i ) := V T (T — t,x,i), V (f, x, i) € [0, T] x M d x I m , (3.9) 

for any T > 0, where V T is defined by E5}. 


Remark 3.1 Notice that point (i) of Theorem 12.11 follows from Proposition 13.11 □ 

Proof. Step I. Existence. We begin noting that 

V T (s,x,i) = V T (s + T' — T,x,i), V (s, x, i) € [0, T] x M d x I m , (3.10) 

for any 0 < T < T' < oo. Indeed, V T ' (• + T' — T, •, •) is a viscosity solution to (13.61) on 
[0, T] x W l x I m , so that identification (13.101) follows from comparison Theorem 4.1 in [3] . 
Setting t := T — s in (13.101) . we obtain 

V T (T — t,x,i) = V T {T' — t, x, i), V (t, x, i) G [0,7] x 1^ x I m . 

This implies that the function V given by (13.91) is well-defined. Moreover, V is continuous 
and satisfies a growth condition as in (1 3.8 [) . In addition, from the viscosity properties of 
V T it follows that V is a viscosity solution to system (11.11) on [0, T] x M d x I m , for any 
T > 0. From the arbitrariness of T, we have that V is a viscosity solution to ED on 
[0, oo) x M d x I m . 

Step II. Uniqueness. Let W: [0, oo) x R d x I m -> 1 be a continuous viscosity solution 
to (11.11) satisfying a growth condition as in (13.81) . For any T > 0 define the function 
W T : [0, T] x x I m —> R as follows 

W T (t,x,i ) := W(T — t,x,i), V (f, x, i) G [0, T] x R d x I m . 

Then W T is a continuous viscosity solution to (13.61) satisfying a polynomial growth condition 
as in (13.71) . From comparison Theorem 4.1 in [3] it follows that W T = V 1 . therefore W = V. 

□ 
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3.2 Long time asymptotics 

We present the following stochastic control representation bounds for every viscosity solu¬ 
tion (A, f>) to ( 12 . 21 ) . with cf) satisfying a polynomial growth condition. 


Proposition 3.2 Suppose that Assumption (HI) holds and consider a viscosity solution 
(A, 4>) to ( 12 . 21 ) . Then, for any T > 0, cf is a viscosity supersolution ( resp. subsolution ) to the 
nonlinear backward parabolic system of variational inequalities in the unknown if: [0, T] x 
R d x I m —>• M: 

f d'lfj 

min | - - mi ueU [C l ’ u if(t,x,i) + f(x,i,u) - A], 

( if(t,x,i) - maxj^j [ip(t,x, j) - c(x,i,j)] } = 0 , (f, x, i) € [ 0 , T) x x I m ,(3.11) 

if(T,x,i ) = min j<f(x,j) (resp. rnaxj <f(x, j)), (x,i) £ M ' 1 x I m . 

Suppose, in addition, that f> satisfies 

\4>(x,i)\ < M^(l + \x\ q *), V(x,i) € M. d x I TO , (3.12) 

for some constants > 0 and > 1. Then, for any T > 0, cf satisfies 

sup inf jjx d,)(t,x,i-,a,v ) < cf(x,i ) < sup inf jT x j,\(t, x, i; a, v), (3.13) 

aeA t ,t v£U ct K 1 aeAt,t v&u ct 


\/ (t,x,i) G [ 0 ,T] xR d xI m , 
Jfx,</,)(*, x,i-, a, v) := E 

,</>)(*, x,v, a, v) := E 


with 

s: 


v,) - A)* + 

E 


rt,x,i',a,v j-t,x,i;a,v} 

Tn 


T L,j;,L,ut,u Tt,x,i:a,v\i 

-h„” )l{r n <T} 


neN 

rT 


/ (/(X*’ x ’ i;a ’Vs’™ , >s) - Aids + max (j>(Xj, x ’ v ’ a,v , j) 

It 3 


E c < x 


t,x,i:a,v jt,x,i\a,v T t,x,i:a,v \i 
r„ >V >4; )l{r„<T} 


neN 


Remark 3.2 Notice that from the viscosity properties of cf we also know that is a 
viscosity solution to the system with terminal condition <f> itself: 

r dijj 

min | - -A-(t,x,i) - inf ue( y [^’^(t,x,z) + f(x,i,u ) - A], 

< ip(t,x,i) - maxj^i[ip(t,x,j) - c(x,i,j)\} = 0, (t,x,i) 6 [0, T) xR^x I m , 

ip(T,x,i) = <f>(x,i), (x, i) £ M. d x I m . 

Now, suppose that cf satisfies (13.12|) and condition (HI)(iii), i.e., 

<t>(x,i) > max [(f(x,j) — c(x, i,j)] , V (x, i) € W l x I m . (3-14) 
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Then, from Corollary 4.1 in [3j it follows that <p admits the representation 


4>{x,i) 


sup inf jT Xd) St,x,i;a,v), V (t, x, i) € [0, T] x R d x I m , (3.15) 


with 


E 


( /(x M4;c 


; ,u s ) - A)ds + </>(Xy 


; -rt,x,i]a,v\ 

? i T / 


£ 'Wf*”'”. r r~ 4f A “’”) 1 { ,» < T) 


neN 


However, since (A, <)>) is only a viscosity solution to (12.21) . it is not obvious that (|3.14l) holds. 
For this reason, we introduce the two systems in (13.111) with terminal conditions mhij <p{x, j) 
and maxj cp(x,j ), which clearly satisfy condition (13.141) . since c is nonnegative. □ 

Proof. The fact that 0 is a viscosity super/subsolution to (13.111) follows obviously from 
the viscosity properties of q i, since < p does not depend on time t. 

From Corollary 4.1 in [3] we know that there exists a unique continuous and with 
polynomial growth viscosity solution ip (resp. ip) to the system of variational inequalities 
(13.111) with terminal condition miiij (p{x,j) (resp. rnaxj cp(x,j)). From comparison Theorem 
4.1 in [3] we have 

ip < <p < ip. 

Using again Corollary 4.1 in [3], we see that ip and ip admit the stochastic control repre¬ 
sentations 


ip{t,x,i) = sup inf J? x >Jt,x,i]a,v), ip(t,x,i ) 

— aeA tl t v£U t’t 

V ( t,x,i ) € [0,T] xR d x I m , from which (j3. 131) follows. 


_ jr 

sup inf Jr X(l>) (t,x,i;a,v ), 

a&At,t v&U ^ 


□ 


From the representation formula for V and the bounds on a generic viscosity solution 
(A, cp ) to ( 12 . 2 p . we deduce the following result when cp satisfies a polynomial growth condition 
of second degree. 


Proposition 3.3 Suppose that Assumptions (H1)-(H2) hold and consider a viscosity so¬ 
lution (A ,(p) to (12.21) . with (p satisfying 

\(p{x,i)\ < + \x\ 2 ), V(x,i) € R d x I m , (3.16) 


for some constant M,f > 0. Then 

V(T, x, i) t- yoo 


V (x, i) € R d x I m . 


In particular, A is uniquely determined for all viscosity solutions (A, < p) to ( 12 . 21 ) . with cp 
satisfying a polynomial growth condition as in (13.161) . 


Remark 3.3 Notice that Proposition 13.31 gives the uniqueness of A and one of the conver¬ 
gence results claimed in Theorem 12.21 □ 
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Proof. From (13.91) we have V(T,x,i) = V T (0,x,i). Therefore, using (13.51) we obtain 

V(T,x,i ) = sup inf J T (0,x,i',a,v). 

Q(G^4o,0 veU 0,0 

On the other hand, taking t = 0 in ()3.13[) we find 

sup inf jT Xtj)) (0,x,i;a,v) < < sup inf jT Xej)) (0,x,i;a,v). 

a£A 0 ,0 v&u 0,0 v ' ae^to.o v&u 0,0 

Therefore 


\V(T, x,i) — XT — cf>(x,i)\ < sup sup E[|g(Xp I,l ’ a,u , 4^ + max , j)|] • 

a€.4o,o v&Aofi j 

From the growth condition on g and cf> , and using estimate (13.31) . it follows that there exists 
some positive constant C, independent of T, x, i, such that 

\V(T,x,i) — XT — c/)(x,i)\ < C( 1 + |x| 2 ), 

from which the claim follows. □ 


4 Asymptotic behavior of the elliptic system 

In the present section, we study the elliptic system of variational inequalities (11.31) . and in 
particular the asymptotic behavior of V 13 as /3 tends to zero, which will entail the existence 
of a viscosity solution (A, 4>) to the ergodic system (12.21) . Similarly to the parabolic case, we 
can derive a stochastic control representation for V 13 in terms of an infinite horizon robust 
feedback switching control problem. However, as we shall emphasize below, it is convenient 
to derive also another representation for VA known as dual representation formula, inspired 
by S3 and based on randomization of the controls a and v. 


4.1 Motivation for the randomization approach 

We begin presenting the representation of as value function of an infinite horizon robust 
feedback switching control, which reads as follows: 


V@(x,i) := sup inf J^(x, i; a, v), V (x,i) £ R d x I m , (4.1) 

a€»4o,0 veU 0,0 


with 


jP(x,i;a,v ) := E 


COO 

Jo 


0 ,x,i:cx.,v t 0 ,xA\ol,v \ i, 

t ih , v t)dt 


- ]T e -^n c{x ^\ A s ’ i: “’ w , i° T ^ a n l {T „<oo } 

' ^ ‘71 

nG N 

where r n stands for T n-(x 0,x, ' l ’ a ’ v , and the state processes X °’ x,r ’ a ’ v 1 i°> x > r ’ a ’ v satisfy 

the first two equations in (|3.ip with t = 0 and for any T > 0. Here, we do not pause on 
the technicalities, since the formulation of the stochastic control problem is analogous, with 
some obvious modifications, to that of the finite horizon case, already recalled in Section 

ram 
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Proposition 4.1 Let Assumptions (HI) and (H2) hold. Then, for any /3 > 0, the func¬ 
tion V& defined by (14.11) is the unique continuous viscosity solution to system (11.31) satisfying 


a linear growth condition 


sup 

(a:,i)GR d xI m 


\yP(x,i)\ 

1 + Ixl 


< oo. 


We do not report the proof of Proposition U.ll here (which provides statement (ii) of Theorem 
m, since it can be done proceeding as in the finite horizon case, for which we refer to 
Corollary 4.1 in [3]. We just observe that the proof is based on the stochastic Perron 
method, which yields, as a by-product, the following dynamic programming principle: 


V^(x,i) = sup inf IE 
aeAo.o v ^ u o,o 


e -P T v ^ x 0m v j0,mv) + / e -ptf( X °m v j°mv iVt )dt 


—pTn ri (Y'0i x ,i]Ct,v r0,x,i-,a,v j0,x,i;cx.,v\-t 

T n ’ 1 T ~ l 1 T n ) L {^n<T} 


^re- pr ’c(x: 

neN 


, V(i,i)el d xl m , (4.2) 


for all T > 0. Identity (14.21) implies in particular the inequality 


V^(x,i) > max [V@(x, j) — c(x,i,j)] , V (x, i) G R d x I m . (4.3) 

The above inequality (14.31) is the only result, derived from the stochastic control represen¬ 
tation ED, that we shall exploit. Instead, for all the other results, we shall use the dual 
representation formula for . To understand why, we begin noting that, because of the 
feedback form of a, from (|4.1|) it is not clear how to prove some properties of V^, which 
are crucial to perform the asymptotic analysis. As an example, for the proof of the uniform 
Lipschitz property of V^ with respect to x we need an estimate of the following type (see 
estimate (14.81) 1: for any t > 0, there exists a constant L t > 0, depending only on t, such 
that 


sup E |-| X o,«_ x o,< Lt \ x - x 'l Vs,s' £* d . (4.4) 

i&m,OL£Ao.Q,V&Aofi 

It is however not clear how to prove estimate (14.41) from representation (14.11) . since the 
evolution of the process I (which influence the dynamics of X through the coefficients b 
and a) depends on the starting point, x or x', due to the feedback form of a. 

As a possible solution to the issue raised above, one could consider the Elliott-Kalton 
version of the infinite horizon robust switching control problem (which can be formulated 
in a similar way to the finite horizon case, for which we refer to Section 4.2 in [3]). More 
precisely, suppose we are able to prove that V 13 is the value function of the Elliott-Kalton 
version of our control problem. Since non-anticipative strategies for the switcher take values 
in the class of all switching controls (not necessarily of feedback type), estimate (|4.4|) follows 
easily from that representation (the dynamics of I is no more influenced by the starting 
point x or x'). The drawback of this approach is the proof that V@ is indeed the value 
function of the Elliott-Kalton formulation, which in general relies on delicate measurability 
issues arising in the proof of the dynamic programming principle, firstly faced in the seminal 
paper [9]. 
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All alternative to the Elliott-Kalton representation of V 13 is a dual representation for¬ 
mula (in the sense of HZ], Section 2.3) based on randomization of the controls a and v 
(see Remarks ED and 14.21 for some insights on the dual representation formula). This lat¬ 
ter turns out to be easier to derive, since it avoids the proof of a dynamic programming 
principle, but it still allows to prove estimates for the process X as (EH) above. For this 
reason, our aim is now to prove that V^ admits a dual representation formula, which can 
be deduced starting from an opportune penalized elliptic system of variational inequalities 
that we now introduce. 

4.2 Penalized elliptic system of variational inequalities 

For any n £ N and f3 > 0, consider the following penalized system of variational inequalities 
in the unknown V ^' n : x I m -> I: 

j3V^’ n (x,i) — inf \C l,u V^’ n (x,i) + f(x,i,u) ] (4.5) 

u£U 

m 

_ri 5Z l vf) ’ n ( x ij) ~ V 0 ’ n (x,i) - c(x,i,j)] + = 0, 

3 = 1 

for any (x,i) £ M. d x I m , where h + = max(/i, 0) denotes the positive part of the function h. 
Our aim is to prove that there exists a continuous viscosity solution V^ ,n to system (14.511 . 
converging to Vd as n tends to infinity, such that V^ ,n satisfies a linear growth condition 
and other opportune estimates uniformly in n, so that they still hold for V 3 letting n —X oo. 
We postpone the proof of the convergence of W 3,n towards , and we begin focusing on the 
proof of the estimates for V^ ,n , for which we adopt a probabilistic approach. In particular, 
inspired by the results in m, we derive Feynman-Kac and dual representation formulae 
of V^ ,n by means of a backward stochastic differential equation with partially nonnegative 
jumps on infinite horizon. 

4.2.1 Feynman-Kac and dual representation formulae of V^' n 

We begin introducing some notations (to simplify the presentation, we redefine certain 
symbols as 0 or F, already used in Section [31 since no confusion should arise). 

Let (P, J 7 , P) be a complete probability space, W = (W t )t >o a d-dimensional Brownian 
motion, ir a Poisson random measure on M + x I m , /i a Poisson random measure on R + x U, 
such that W, 7r, and /j, are independent. We assume that 7r has intensity measure , & 7r (di)dt, 
where d^^di) = d-j(di) and 6j denotes the Dirac delta at j £ I m . We also suppose 

that /i has intensity measure fl^dujdt, where is a finite measure on ( U,B(U )) ( B(U) 
denotes the Borel cr-field on U) such that: 

(i) The support of is the whole set U, namely d^O fl U) > 0 for any open subset O 
of M 9 satisfying O fl JJ / 0. 

(ii) The boundary dU = U \ U of U is d^-negligible: d^dU) = 0. 

We denote by iv(dt,di) = n(dt,di) — d n (di)dt and p,(dt,du ) = fj,(dt,du ) — d^(du)dt the 
compensated martingale measures associated with 7r and /u, respectively. We also set F = 
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(J't)t>Q the completion of the natural filtration generated by W, tt, and /u, and we denote 
by V the cr-field of F-predictable subsets of x [0, oo). 


Forward SDE and randomization. For any (x,i,u) £ x I m x U, we introduce the 
forward jump-diffusion Markov process (X, I, T), which evolves on [0, oo) according to the 
following system of stochastic differential equations: 


for all t > 0. 



(4.6) 


Remark 4.1 The process (X,I,T) satisfying system (14.61) will be the forward and driving 
process in the Feynman-Kac and dual representation formulae of V^ ,n . The expression of 
(14.61) is derived following HZ] and it is inspired by the stochastic control representation of 
. As stated in Proposition 14.11 V& is related to an infinite horizon robust switching 
control problem, whose state process evolves according to the first two equations in (13.11) 
(with t = 0 and for any T £ [0, oo)). Then, (14.61) is obtained from (13.11) by means of a 
randomization of the switching and open-loop controls, which is fulfilled introducing the 
pure jump Markov processes I and T driven by independent Poisson random measures. 
Hence, compared to (13.11) . the pair ( X,I ) in (14.61) is an uncontrolled process. □ 


It is well-known that under Assumption (HI) , for any ( x,i,u ) € x I m x U, there exists 
a unique solution (X x ’ l ’ u ,P,T u ) = (X^ ,l,u , II, r“)t> 0 to system (14.61) . and the following 
standard estimate holds: for any T > 0 and p > 2, there exists some positive constant C p t 
such that 


E 


sup 

L 0 <t<T 




< C Pi t{ 1 + M p ). 


We conclude this paragraph with two important estimates resulting from the dissipativity 
condition (H2), which call on a family of probability measures we are going to define. 
For any n £ N\{0} and k £ N, let E n be the set of V (8> ^ (I m ) - me as ur ab 1 tQ maps valued 
in (0, n], Vfc be the set of V <g> B ( U )-measurable maps valued in [1, k + 1], and denote by 
5 = U ne N\{o}H n , V = UfcgNVfc. We consider for £ £ E, v £ V, the probability measure 
equivalent to P on (Q, Tr), for any T > 0, with Radon-Nikodym density: 


dF 


Tt 


C T V := 


(Jo J, ■ £t (J 0 ( 4 - 7 ) 


where £(■) denotes the Doleans-Dade exponential local martingale. Proceeding as in Lemma 
2.4 of [TT], we see that ^ ,v is a “true” P-martingale (hence defining a probability measure 
P^ through (14.71) 1 since are essentially bounded and , d /t are finite measures on \ m 

1 denotes the power set of I m . 
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and U, with € L 2 (fl, J-jr, P) for any T > 0. By Girsanov’s theorem, we recall that 
W remains a Brownian motion under P^, and the effect of the probability measure P^ 
is to change the compensator ^{dTjdt of ir under P to £t(i) , & n (di)dt under P*’", and the 
compensator ’d flL {du)dt of p under P to n t {u)d n{du)dt under P^’". We denote by TT^(dt, di) = 
7 r (dt,di) — ^t(i)^iv(di)dt and p u (dt,du) = p(dt,du ) — u t (u) , d tl {du)dt the compensated mar¬ 
tingale measures associated with tt and p under ¥^ ,u . Finally, E^’" denotes the expectation 
with respect to P^’". 

Lemma 4.1 Let Assumptions (HI) and (H2) hold. 

(i) For all t > 0, x, x' € i € I m , u £ U, 

sup E^Ux^-Xf’^l 2 ] < e~ 2lt \x — x'\ 2 . (4.8) 

(ii) There exists a positive constant C, depending only on Mt ) <7 = sup^ u ) gIr n xu(\ b (0A,u)\ 
+ ||cr(0, i, it)||), L\, and 7 , such that 

sup ^ V [\X^ U \ 2 ] < C(l + |x| 2 ), (4.9) 

f>o,£eH,i/eV 

for any (x, i, u) £ M d x I m x U. 

Proof, (i) Estimate (14.8)1 . The proof of estimate (14.81) can be done proceeding as in 
Lemma 2.1 (ii) in [ 6 ]. Let us just give an idea of the proof. Firstly, we apply Ito formula 
to |A's’*’ u — Xf ’*’ u | 2 between s = 0 and s = t > 0, then we take the expectation E^ with 
respect to P^, and finally we use the dissipativity condition (12.lj) . In conclusion, we end 
up with 

X x,i, u _ x f,i,u\2 j < | x _ x '|2 _ 2 7 /■* 

Jo 

Then, the claim follows from Gronwall’s inequality. 

(ii) Estimate ()4.9I) . The result can be proved proceeding as in Lemma 13.21 □ 


[ 1*3 


-Xi 


1 ds. 



Backward SDE with partially nonnegative jumps on infinite horizon. For any 

T € [0, 00 ), we denote by Vt the <r-field of F-predictable subsets of 0 x [0, T] and we 
introduce the following spaces of random maps: 


S|, the set of real-valued cadlag F-adapted processes Y = (lt)o<t<T satisfying 


\Y\\\ := E 

H s 2 


sup \Y t \ 
L 0<t<T 


< OO. 


We also denote S 2 oc := Dt>oSt- 

LP(W), p > 1, the set of M d -valued TV-measurable processes Z = ( Z t )o<t<T satisfy¬ 
ing 

\Z\\ P „ := E ( / \Z t \ z dt | < 00 . 


'lP(W) 


L 


We also denote Lf oc (W) := n T > 0 LT( W )- 
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L!^( 7 r), p > 1, the set of Vt < 8 > SY (I m )-rneasurable maps L: 0 x [0,T] x l n 
satisfying 


\L\\ p r 




:= E 


rT / 

W =1 


)r * 


< oo. 


We also denote L^ c ( 7 t) := nT>oL^( 7 f). 

L^,(/ 2 ) the set of Vt <8> 13 (U)-measur able maps R: 0 x [ 0 , T] x U —> M satisfying 

r-T 


ll^ll 


l t(/U 


:= E 


/ 

L do 


W 


\R t (u)f'&Jdu) dt 


< oo. 


We also denote L^ c (/2) := nT>oL!^(/2). 

the set of nondecreasing predictable processes K = ( K t )o<t<T G S^, with Kq = 
0 , so that 


I if I 


= E|if T p 


We also denote K 2 c := OtxiK 2 


Let us now consider, for any (3 > 0, n G N, and (x, i, u ) G M d xl m xU, the following backward 
stochastic differential equation with partially nonnegative jumps on infinite horizon: 


Y 


f),n 


= Yfi’'~ 


rl rl rl 

P Yf’ n ds+ /(*?*«, i],r * a )ds-J2 L^’ n (j)ds 

Jt Jt . =1 Jt 

m fT 

+ / [L^ n U) - c(X^’V‘_, j)] + d* - [K^ n - (4.10) 

z3 n dW s — [ T [ LP’ n (j)t(ds,dj)- [ T [ RP’ n (u')jl(ds, du'), 
d t d d t d jj 


3 = 1 
f T 


for any 0 < t < T, T G [0, oo), and 

Rf’ n (u') > 0, cflP ® dt 0 i & tl (du , )-a,.e. 


(4.11) 


Our aim is to prove that the penalized elliptic system (14.51) is related to the maximal solution 
to the above BSDE with partially nonnegative jumps (14.10D - (14. 1 11) . that we now define. 

Definition 4.1 For any (3 > 0, n G N, and (x, i, u ) G W l x I m xU, we say that a quintuple 

(YP,n,x,i,u, Z fi,n,x,i,u, L P,n,x,i,u^ R P,n,x,i,u^ K / 3 ,n,x,i,uj £ Sf oc X L 2 C (W) X L 2 c (ff) X L 2 C (/I) X K 2 C 
is a maximal solution to the BSDE with partially nonnegative jumps on infinite horizon 

M-gUD if: 

(i) |lf ,rw ’“| < C(1 + \X?' l ’ u \), for all t > 0 and for some positive constant C. 

(ii) For any other solution (Y_d ,n , Zfi' n , Lfi ,n ,RP' n ,K^ ,n ) g S 2 C x L 1 2 oc (W) x L 2 oc (7r) x 
Lj 2 0 c (Ji) x K 2 c to (I4.10D - (14.11D satisfying |Y)f’ n | < C(1 + \X°[' l,u \), Vt > 0 and for 
some positive constant C_ (possibly depending on (3,n,x,i,u), we have 


Y 


(3,n,x,i,u ^ -y'/3,n 
— L-t 5 


P-a.s., for all t > 0 . 
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Proposition 4.2 Let Assumptions (HI), (H2), and (HU) hold. Then, for any (3 > 0 
and n G N, we have: 


(i) For any (x, i, u) G x I m x U, there exists a unique maximal solution to (I4.10f) - (14.111) 
denoted by (y r l^ ,n,x J ,u Z^ ,n,x J ,u L^-> n ^ x J^ u j^p^ n ^ x J^ u 


(ii) Given (x, i) G x I m , for any u G U the random variable Y^' n,x,i,u is equal P-a.s. to 
a constant independent of u G U. Moreover, the function V^ ,n : R d x I m —>• R given 

by the Feynman-Kac formula: 


V^ n (x,i) 


Tr(3,n,x,i,u 

r o 


V (x,i) G M d x I m , 


for any u G U, is a continuous viscosity solution to system m and satisfies the 
linear growth condition 

sup 


\yP’ n (x,i)\ 
1 + \x\ 


Proof See Appendix, in particular Proposition lA.il for (i) and Proposition IA.21 for (ii). 


□ 


Corollary 4.1 Let Assumptions (HI), (H2), and (HU) hold. Then, for any (3 > 0 and 
n G N\{0}, the following dual representation formula for V^ ,n holds: 


V 0 ’ n (x,i) 


sup inf E^ 


roo 

/ e-^f(X^ u ,F t ,Tf)dt 
Jo 

roo r 

- / e~ /3t c(Xf ,l ’ u , I \_, f)7r(dt, dj) 

J 0 J I m 


(4.12) 

V (x, i) G x I m , 


for any u G U. 


Proof. As a preliminary step, the present proof involves the doubly indexed penalized 
BSDE (IA.1D introduced in the Appendix. Indeed, we firstly derive a dual representation 
formula for V^ ,n,k (x,i,u) = Y^’ n,k ’ x ’ z ’ u , then we pass to the limit as k —> oo, using that 

yp,n,k,x,i,u ^ Y P,n,x,i,u = yfl.nfaQ p^.g., to derive gjg) . 

Step I. Dual representation formula for V^’ n,k . Fix n G N\{0}, k G N, and ( x,i,u ) G 
x I m x U. Our aim is to prove the following dual representation formula 

roo 

/ e-^f(xf' u ,llT u t )dt (4.13) 

Jo 

roo r 
J 0 J I rn 

To this end, take ( £ S„ and u G Vk- Then, given T G [0, oo), we add and subtract to 
(IA.ll) . with t = 0, the two terms (we adopt the simplified notation Y^ ,n,k for yA, n , k ,x,i,u^ 
and similarly for the other components) 

f f L^ n,k (j)^ t (j)d 7r (dj)dt, f f R^’ n ’ k (u , )i/ t (u , )'d IJ ,(du')dt. 

JO Jim JO JU 


V^’ n,k (x, i, u) = sup inf E^ 
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From the integrability conditions on L^ ,n,fc (resp. it follows from Proposition II. 1.28 

in m that the stochastic integral in (I A. ID with respect to n (resp. ju) can be written as 
the difference between the integral with respect to 7r (resp. fi) and that with respect to 
its P-compensator d 7T (dj)dt (resp. 1 9 fl (du')dt). The same remark applies to the stochastic 
integral of L^ ,n,k (resp. ) with respect to n^ (resp. fi v ). Then, rearranging the terms 

in (E3D, we end up with 


vP,n,k 

*o 


Y 


(3,n,k 


(5 f T Yf’ n,k dt + 

Jo Jo 


(4.14) 


m r.J 


+ n Y^ I [ L t’ n,k ti)- c ( x t' l ' U , I l-J)] +dt - k I I [ R t’ n,k ( u ')\ $ii(du')dt 


l=i 

,-T 


0 JU 
T 


[ Z^’ n,k dWt — f [ L^ n ’ k (j)TT^(dt,dj) - ( I Rt' n,k {v!)jl v (dt, du') 
Jo Jo Jim Jo JU 

m pT rT r 

22 Lt’ n,k U)Ct(j)dt- / R%' n ’ k {u'){v t {v!) - l)du,{du')dt. 

, Jo Jo Ju 


Now, we apply Ito formula to e J t Yf ,n ’ k between 0 and T, afterwards we add and subtract 
the term 


171 r.J 




1 = 1 

Therefore, from (14.1411 we obtain 

rT 


m f .j 


Jo • , Jo 


l=i 


m „ T 

+ £ / e~^{n[L^ k {j) - j)] + - l) «•*-«, jj_, j)\ }dt 

l=i ' 0 


/ e ^ {k[R^’ n,k (u 1 )] + {y t (u') - l)R^ n,k {u')}'d il {du')dt 

to Ju 

rT e -Pt Z ?’ n ’ k ' 

Jo 


(4.15) 

■ f T e-^Z^dWt- [ T [ e-^L^ n ’ k (j)^(dt,dj) - C [ e~^ R^ n ' k J'JJdtJu'). 
Jo Jo Jim Jo Ju 

Reasoning as in Lemma 2.5 in m we can prove that the three stochastic integrals appear¬ 
ing in ()4. 151) . which are P^-local martingales, are indeed true P^ ,!/ -martingales. Therefore, 
taking the expectation E^’" with respect to P^ in (14.151) . we find 

Yg' n ' k = G t (M (4.16) 

m , T 

+ Y / {„[L^%) -c (xU\r t -.j )} + - m[L^*(i) - c(Xf,i )]}dt 


1 = 1 ' 
-fj 

Jo Ju 
where 


e l3t E^ ,u {k[Rt’ n,k (u')] + J t (u') — l)R^ n ’ k (u')^‘& fl (du')dt, 




-pr Y P,n,k + [ T e-^f(X^ u , ilTjdt 

Jo 


21 













m pT 


Y1 / e ht( i X t ,l,U ^]-^)it{f)di 


J=l J0 

Let us prove the following identities 

YJ?’ n ’ k = sup inf GW£, z/) = inf sup GV(£,zA 
?eHn ^V fe ^v feeeHn 

We begin noting that, for any £ € H n and £ V^, we have 


(4.17) 


n 


[L^ n ’\j)-c(X^’ u Ji_,j)] + -Z t (j)[LV’ n ’\j)-c(X^’ u Ji_,j)\ > 0, 

k[RP’ n ’ k (u')]-+ (v t {u')-l)RP’ n ’ k {u^ > 0 . 

Now, for every e > 0, define £ £ € as follows 


e t u) = 


n, 






On the other hand, let z/* € V& be given by 


L%' n ’ k (j)-c(x?’ i ’ u ,r t _,j)> o, 
-i<L^ n ’ k (j)- c (xf’ u ,r t -,j) <o, 
L^’ k (j)-c(xf’ u ,P t _,j)<- 1. 


k + 1, R^ n ’ k {u') < 0, 

1, R^ n ’ k {u')> 0. 


*£(«') = 


Then, from (14.161) we obtain 

Gt(£x*) < itf*’"’* = G T (£ £ ,^)+ e <5 T (f,^) < G t (£ £ x) + ^t(<£V), (4.18) 


for any £ £ and z/ € 14, where 

m pj' 


no p 

5t{€,v) = yy / 

+i 






(c(X t ’ /)- , j) Lj ’ ’ (j)) 1 {_i< i 0."A( J -)_ c ( X *.i,'yi_ j)< 0 } 

dt. 


Notice that 0 < <5 t(£, v) < X^=i / 0 e /3t dt < m/P, therefore from (14.181) we have 


Gt(£,i/*) < ^’ n ’ fc < Gt(£ £ , z') + e V£ e S n , z/ € V fc 


m, 


which implies 


inf sup G t (£x) < Y^’ n,fc < sup inf G T (£x)+e-y 
^eVi, £es n z/eVj, p 


Since e is arbitrary and the inequality supg gHn inf„ G y fe Gr(£, z/) < inf„ e y fc sup^ eSn Gy(£, z^) 
holds, we deduce identities (I4.17p . We also observe that, from (|4.18|) and the boundedness 
of <5 t(£ £ X*), we have Y^' n ’ k = lim £ _ >0 + Gt(£ £ X*), therefore (£ e ,z/*) in an e-saddle point 
of Gt(£, z') on H n x Vfc. 
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To obtain the dual representation formula (14.131) . we now pass to the limit in (14.171) as 
T —> oo. Firstly, we notice that, by estimates (1A.2D and (14.91) . it follows from Lebesgue’s 
dominated convergence theorem that 

sup E^[e^ T |y T ^ fc |] T -=^° 0. (4.19) 


Similarly, from the uniform linear growth condition of / and c with respect to x, the 
boundedness of £ E E n , and estimate (14.9]) , we have 


sup E^’" 
Ses n ,yev fc 


e -^| f(x?'’ u ,r t ,r?)\dt 


sup E s,i 
$es n ,i/ev fe 


L JT 

OO 




3 =1 ' 


T—>oo 


T—>oo 


o, 


(4.20) 

(4.21) 


The above convergence results imply that we can pass to the limit in (14.171) as T -> oo, 
and we find (we are interested only in the first identity in (14.171) ) 


YJ?’ n,k _ g inf E^’ 1 


p OO 171 poo 

/ e-^f(X^ u ,P t ,T^dt-22 / e-^c(xf’ u ,r t -,j)^t(j)dt 

Jo j=1 Jo 


The second integral in the above identity can be written with respect to n, using the 
definition of P^-compensator of it (see, e.g., Theorem II. 1.8(i) in |15j). so that we end up 
with the dual representation formula (|4.13l) for V^ ,n,k (x,i,u) = Y 7n ’ k . 

Step II. Dual representation formula for yJ’ n . From the convergence \ YQ ,n ’ x,i,u 

P-a.s., as k —>• oo, we obtain 

Y^,n,x,%,u _ j im / sup i n f Goo(£, u)\ > sup inf Goo(^, n), 
fc->-oo V ^ev fc / veV 

where 

poo poo p 

Goo(M = IE 5 ’" / e-^f(X^’ u ,li,T^)dt- / / e- pt c(X?' l ' u ,r t -,j)7T(dt,dj) 

. J 0 j 0 j Im 

On the other hand, from ()4. 181) we have (recalling that <5 t(£, z') < m/(3) 


(4.22) 


D —0t < yX,i, u ji 


Y d,n,x,i,u < yp, n ,K < G T (f,^)+e^, W E Vfc. 

Using the convergence results (14.19I) - (I4.20I) - (I4.21I) . we can pass to the limit as T —>■ oo in 
the above inequalities, so that we obtain 


r/ 3 ,n,k 


m 


^ -y/3,n,k 

r o - r o 


m 


< Goo(f £ , v) + e—, We Vfc, 


which implies 


ref’”"'" < inf G«,«V) + £ ^. 

i/eVfe p 


Since k and e are arbitrary, we end up with 


V 
J- r 


(3,n,x,i,u 


0 < sup inf Goo (C,^). 

The above inequality, together with (14.221) . yields the thesis, recalling from Proposition 


Iran that vP’ n (x,i) = u c 


_ T7-(3,n,x,i,u 


0 


for any ( x , i, u) E ffir x I m x U. 


□ 


23 
































4.2.2 Estimates 


From the dual representation formula (|4.12|) . we deduce the following estimates for V+ n . 
Corollary 4.2 Let Assumptions (HI), (H2), (H3), and (H U) hold. 

(i) For any (3 > 0 and n G N\{0} ; we have 

\V+ n (x,i) -V^’ n (®',i)I < —\x-x'\, (4.23) 

7 

for all x, x' G R d , i G I m . 

(ii) There exists a constant C > 0, depending only on L 2 , M := sup( iiU ) e j mXt / |/(0, i, tt)|, 
and the constant C appearing in estimate m, such that, for any f3 > 0 and n G 
N\{0}, 

\{3V+ n (x,i)\ < C(1 + |x|), (4.24) 

for all (x, i) £ R d x I m . 

(iii) For any /3 > 0, n G N\{0} ; and (x,i) G R d x I m , we have 

V+ n {x,i) < V+ n+1 {x,i). (4.25) 


Proof, (i) Estimate (I4.23|) . Fix x, x' G R d , i G I m , and u G U. From the dual representation 
formula ()4. 121) and since c = c(i,j) does not depend on x under (H3), we have 

’ n (x,i)-V+ n (x',i) | < sup E*’" 

£eE„,i/eV 



/»oo 

/ e"^|/(X t a 

■Jo 


\P t ,T?)-f(X x t 


,r t ,T?)\dt 


Then, using the Lipschitz property of / in (HI) (ii), together with estimate (I4.8|) . we obtain 
\V^’ n (x,i) — V^’ n (x',i)\ < L 2 \x — x'\ f e~^ +1 ^ t dt = lx — x'\ < —\x — x'\, 

Jo P + 1 1 

from which the claim follows. 

(ii) Estimate (14.24j) . Given (x,i) G R d x I m and uG(J, using again the dual representation 
formula ()4. 121) we hnd (from the nonnegativity of c) 


pvP’ n (x,i) 


" /‘OO 

< sup E^ / /3e-^|/(X^’V*,rr)|dt 

£es n ,i/eV L-m 


(4.26) 


On the other hand, take e > 0 and define 

^ = e _P_ _i_ 

m 1 + rnax ?;j - eIm c(i,j)' 

We see that, if e is small enough so that £f < n, then G E n . Therefore, from (14.121) we 
obtain 


pV p ’ n (x,i) > 


inf E^ 
u£V 




Tl -pit 

> 1 t 


l JO 


m r. 

)dt-J2 f 

j— 1 J Ira 


e-^cjx:?’ l ’ u ,r t -,j)?dt 
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— £ 


> — sup E^ e 


r 

/ e-^\f{X x /' u JlT u t )\dt 

Jo 


L Jo 


‘ roo 

> - sup E^ / e-^\f(X^’ u ,li,r^\dt 

?eH n ,i/GV Ljo 


— e. 


By the arbitrariness of e and inequality ()4.26[i . we conclude that 


|/3P /3 ’ n (x,i)| < sup E^ 
£G^n 5 ^GV 


' /“OO 

/ /J e -^|/(X“- i -Vj,I?)|dt 

_ J o 


From the inequality f(x,i,u ) < L 2 |x| + M and estimate (14.91) . we see that there exists some 
positive constant C (only depending on L 2 , M, C) such that 

roo 

\pv^ n {x,i)\ < C(l + |x|) / Pe~ 0t dt = <7(1 + |s|). 

Jo 


(iii) Monotone property (I4.25p . Inequality (|4.25l) follows from the dual representation for¬ 
mula (14.121) for V^’ n , noting that E n C E n+ i, Vn € N\{0}. □ 


4.2.3 Convergence of V^ ,n towards V 13 

From Corollary 14.21 it follows that, for any /3 > 0, the sequence ( V /3,n )n>i is monotone 
nondecreasing and satisfies the following linear growth condition: 

V?’ n (x,i) < % + — 1®|, (4.27) 

P 7 

for all n £ N\{0} and (x,i) £ R rf x I m . As a consequence, we have the following result. 


Proposition 4.3 Let Assumptions (HI), (H2), (H3), and (HCO hold. Then, for any 
(3 > 0, there exists a function v@ : R d x I m —x R given by v^(x,i) = Y\m. n ^. 00 V^' n (x,i), for 
all (x,i) El^x I m , which admits the dual representation formula 


roo 

/ e-^f{X^ u ,r t Xf)dt 

Jo 

roo r 

- / e~^c(r t -,j)n(dt,dj) , 

JO J I m 

for any u £ U . Moreover, v@ has the following properties: 

\yP(x,i) — yP(x',i)\ < —\x — x'\, 

7 

\0v p (x,i)\ < C(l + |x|), 


V r [X, l 


= sup inf E^ ,; 
£ge »&> 


V (x, i) £ R d x I m , 


for all x,x' £ R d and i £ I m , where the constant C is the same as in Corollary \f. 2( ii) . 

Proof. The existence of vJ follows from the monotone property of (VP ,n )n> 1 (which is 
a consequence of (|4.25[i ) and from the uniform linear growth condition (|4.27l) . The dual 
representation formula holds since V^ ,n satisfies (|4. 12[) and E n C H n+ i C • • • C U n >iH n = H. 
Finally, the two stated properties of v 13 are implied by estimates (14.231) and (14.241) . □ 
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Proposition 4.4 Let Assumptions (HI), (H2), (H3) ; and (HU) hold. Then, the func¬ 
tion is the unique continuous viscosity solution to system satisfying a linear growth 
condition 

\v^(x, i) | 


sup 


1 + Isl 


< oo. 


In particular, vP coincides with the function V 13 defined by (14.111 . Moreover, we have 


\v@(x, i) — yP(x,j)\ < c := max c(i,j), 

i,j&m 


(4.28) 


for all x G W l and i,j G I m . 


Remark 4.2 We refer to the function v@ introduced in Proposition 14.31 as dual value func¬ 
tion of the dual robust switching control problem. On the other hand, we say that V 13 is the 
primal value function and the associated infinite horizon robust feedback switching control, 
recalled in Section su is the primal robust switching control problem. Then, Propositions 
14.31 and 14.41 state that these two value functions coincide. Notice that the dual control 
problem is a two-player zero-sum stochastic differential game of the type control vs control. 
In general, the lower and upper value functions of a control vs control (more precisely, 
open-loop control vs open-loop control ) game do not coincide with those associated to the 
Elliott-Kalton version of the game, where the strategy vs control formulation is adopted 
(see, e.g., Exercise 2.1 (ii), Chapter VIII, in [2]). However, we observe that our dual control 
problem is in weak form as in [20], therefore, as emphasized in [20] . it might be interpreted 
as a feedback control vs feedback control game. □ 

Proof (of Proposition 14.4[) . Recall that V 3,n satisfies ([4.2311 and vP is the pointwise 
limit of the sequence (E /3,n ) n >i- Then, we have 


\V^’ n (x',i) — v^(x,i)\ < — \x — x'\ + \V l3 ' n (x,i)—v l3 (x,i)\ 

T 


n—>• oo 
x'—tx 


Therefore, for all (x,i) G R d x I m , 

'jP(x,i) = lim V /3,n (x',i) = liminf* V^’ n (x,i) = limsup* 

n->oo n—yoo 


n—>■ oo 
x'—tx 


yf 3 -- 


x,l 


(4.29) 


(4.30) 


where 


liminf* V^’ n (x, i) := liminf V /3,n (x,i), limsup* V^’ n (x, i) := limsup V^’ n (x', i). 


n—>oo 
x'—tx 


n—>oo 
x'^-x 


Step I. Viscosity supersolution property of to (II.3H . Let (x, i) £ R d x I m and (p, M ) G 
J 2 ~yd(x,i) (the second-order subjet of at (x,i), see, e.g., Section 2 in |7j). From (I4.30p 
and Lemma 6.1 (see also Remark 6.2) in [7], it follows that we can find the following 
sequences 


n k oo, x k G R d , (p k ,M k ) G J 2 ’ V^’ nk (x k , i), 


satisfying 


(x k ,V 0 ' nk (x k ,i),p k ,M k ) 


k —^oo 


(x,v f3 (x,i),p,M). 


(4.31) 
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For any j £ I m , we also have the convergence V l3,nk (x k ,j) —$■ v@(x,j), which can be proved 
proceeding as in (14.291) with j in place of i. From the supersolution property of V^ ,nk to 
(14.51) stated in Proposition 14. 2f ii). we have 

/3VP' nk (x k ,i) - inf \b(x k ,i,u) ■Pk + ^tr (aa T (x k , i, u)M k ) + f(x k , i, u) 1 (4.32) 


[V^’ nk (x k ,j) - V^’ nk (x k ,i) - c(i,j)] + > 0. 

3 = 1 


Let us prove that 


v /3 (x,i) — max [v^(x, j) — c(i, j)] > 0. (4.33) 

i¥=i 

On the contrary, suppose that there exists some jo £ I m , jo ^ i, such that 

v p {x,i) - vP{x,jo) + c(i, j 0 ) < 0. 

From the convergences V^ )Uk {x k ,i) v /3 (x,i), V^ ,nk (x k ,jo) —t v@(x,jo), it follows that 
there exist e > 0 and k £ £ N such that 

VP’ nk {x k ,i)-VP’ nk (x k ,j 0 ) + c(i,jo) < s, Vk>k £ . 

As a consequence, we have 


^2 [V P,nk ( x k, j) - vP’ nk (x k ,i) - c(i, j)] + > £, Vk>k £ . 

3 = 1 

Letting k —> oo into (14.321) . we find a contradiction, so that (|4.33l) holds. On the other 
hand, from (I4.32P we have 


pV 0 ' nk {x k ,i) - inf b(x k ,i,u).p k + -tr(aa J (x k ,i,u)M k ) + f(x k ,i,u) 
u€U L Z 

Sending k —>• oo, using (|4.31[) and the continuity of b, a, /, we conclude that 


> 0. 


/3v^(x, i ) — inf b(x, i, u).p + -tr(cr(j T (x, i, u)M ) + f(x, i, u ) 
u£lJ L 2 


> 0. 


Step II. Viscosity subsolution property of v^ to (11.31) . Let (x, i) £ R d x I m and ( p, M) £ 
J 2 ’+v /3 (x,i) (the second-order superjet of v@ at (x,i), see Section 2 in [7]) such that 


v^(x,i) — max [v^(x, j) — c(i, j)] > 0. 
j¥=i 

From (14.301) and Lemma 6.1 in [7], we see that we can find the following sequences 


(4.34) 


n k 


k—foe 


oo, x k £ (p k ,M k ) £ J 2 ’ + V P ' nk (x k ,i), 


satisfying 


(x k ,V l3 ’ nk (x k ,i),p k ,M k ) (x,vP(x,i),p,M). 
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Moreover, for any j E I m , we also have the convergence V 0 ’ nk (x k ,j) v 0 (x,j). Using the 
subsolution property of V 0,nk to (14.51) . we find 


/3V 0,nk (x k ,i) - inf b(x k ,i,u).p k + \tr(aa T (x k ,i,u)M k ) + f(x k ,i,u) 

u£U L Z 


(4.35) 


~ n kYl [' Vl3 ’ nk ( X kyj ) - V P ’ nk (x k ,i) - C(i, j)] + < 0. 

3 = 1 


Prom (14.3411 and the convergence V 0,nk (x k ,j) —>• v 0 (x,j), Vj E I m , we see that there exist 
e > 0 and k £ E N such that 


V 0 ’ nk (x k ,i) - max [U /3 ’ nfc (z fe , j) - c(i, j)] > e, VA: > fc e . 


Therefore, for all k > k £ , we have 


j=i 

Hence, letting k —> oo into (14.35(1 . we end up with 

j3v^(x,i) — inf b(x,i,u).p-\ — ti(acr T (x, i, u)M) + f(x, i, u) 
ueU L 2 v 


0 . 


Step III. Identification v@ = U' 3 . From Proposition 14.11 we know that V^ is the unique 
continuous viscosity solution to system (11.31) satisfying a linear growth condition, so that 
the claim follows. We just notice that this point is based on a uniqueness result for viscosity 
solutions to system (11.31) . This latter can be obtained relying on a comparison principle for 
viscosity solutions to system dm which in turn can be proved proceeding as in Proposition 
3.1 in m, where however the parabolic case is considered and there is no inf ug [/ appearing 
in the system. Here, we simply observe that the proof is based on the standard doubling 
variable technique together with a “no free loop” reasoning introduced in Theorem 3.1 of 
m, which calls in property (Hl)(iv). 

Step IV. Estimate (14.281) . Finally, to prove estimate (14.281) . we notice that from the 
identification v^ = V 13 and inequality (14.31) . we have 

V p (;.x,i) > max [V^(x,j) — c(i,j)\ > V 0 (x,j) - c{i,j), V (x, i, j) E R d x 1^, j ± i. 
This implies that 

V 0 (x, j) - V 0 (x,i) < c(i,j) < max c(i,j), 

i,j£lm 

from which estimate (14.281) follows. □ 


4.3 Convergence results for V 0 

We are now in a position to study the asymptotic behavior of V 0 . More precisely, we have 
the following result, which proves all the statements of Theorem 12.21 concerning V 0 and the 
existence of a viscosity solution to the ergodic system (|2.2j) . 
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Proposition 4.5 Let Assumptions (HI), (H2), (H3), and (H U) hold. Then, there exists 
a viscosity solution (A with (/>(-,i) Lipschitz, for any i £ I m , and 4>(0,io) = 0 for some 
fixed io £l m , to the ergodic system m, such that 

pvP(x,i) A, V(x,i) e R d x I m , 

V^(;i)-V^(0,i 0 ) tj>(;i), Vie I m , 

in C(R d ) 

for some sequence (/3k)k&i, with /3k \ 0 + . 


Proof. Fix io € I m and, for any (3 > 0, set 

A i ■= /3V 0 (O,i), <^( x,i ) := V 0 (x,i) - V^(0,* 0 ), 


for all ( x,i ) e M. d x I m . From Proposition 14.31 estimate (14.281) . and the identification 
v 0 = V 0 stated in Proposition 14.41 we have 

sup|Af| < C, sup|^(x,i)| < —\x\ + c. 

/3>o p> o 7 

As a consequence, by Bolzano-Weierstrass Theorem and Ascoli-Arzela Theorem, we can 
find a sequence ((3k)he N, with f3k \ 0 + , such that 




h—yoo 


^ 2 ? 




k—>qo 
in C(M d ) 


</>(-, 


for some A* e R and </>: x I TO —> M satisfying |^>(x,i)| < L 2 |x |/7 + c, | <j>(x,i) — 4>(x',i)\ < 

L 2 \x — a/l/T, an d ^>(0, io) = 0. Notice that, from estimate (14.281) we obtain 


| 


Pk\V^(0,i) -V^(0,j)\ < he 0, 


therefore A := A* = A j, for all i,j £ I m . More generally, we have 

\p k V Pk (x,i) - \? k \ = h\V Pk (xA)-V^(t),j)\ < f3 k ^\x\ + hc *-=3? 0, 
which implies that 

hV 0k (x, i) k ^7 A, V (x, i) G x I m . 

We now prove that (A, (/>) is a viscosity solution to the ergodic system (12.21) . To this end, 
we begin noting that, from the viscosity properties of V 0 stated in Proposition 14.41 (see 
also Proposition 14.11) . it follows that, for any i £ I m , 4> 0 (-, i) is a viscosity solution to the 
following elliptic equation: 

min |Af 0 + P<f)P(x, i) - mf [C’ u ^(x, i) + f(x, i, it)], 

(/)P(x, i) — max \<fP(x,j) — c(i,j)] \ = 0, Vx£M. d . 
j¥* > 

Then, we define 

F k (x,i,r,p, M) := min { Af fc +/3^r — inf \b(x, i, u).p H— tr(aa T (x,i,u)M) + f(x,i,u)], 

l 0 u&u L 2 v J 
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r - max [(f Pk (x,j) - c{i,j )] }, 


for all k £ N, and 

F 00 (x,i,r,p, M) := min|A— inf [b(x, i, u).p + -tr(cr(j T (x, i, u)M) + f(x, i, u )}, 

L u£U 2 

r - max [(/>(x, j) - c(i,j)\ }, 

Jr 11 > 

for any (x,i,r,p, M) 6 ^ x I m x R x R d x R dxd . We see that 


lim F k (x,i,r,p,M) = F 00 (x,i,r,p, M). 
k—yoo 


Then, from stability results of viscosity solutions (see, e.g., Lemma 6.1 and Remark 6.3 in 
0), we deduce that, for any i £ I m , the function <(>(■, %) is a viscosity solution to the elliptic 
equation 


F 00 {x,i,(j)(x,i),D x (j)(x,i),Dl(l)(x,i )) = 0, 


Vx £R d . 


As a consequence, we conclude that (A, </>) is a viscosity solution to the ergodic system (|2.2|) . 
Finally, we notice that the all family ((3V 13 (x, i))p>o converges to A as (3 —>■ 0 + , since, as 
stated in Proposition 13.31 A is uniquely determined. □ 


Appendix 

A Feynman-Kac formula 

The present appendix is devoted to the proof of Proposition 14.21 Unfortunately, we did not 
find a reference for it in the literature. Indeed, even though Proposition 3.3 and Theorem 
3.1 in [6] do almost the job, they do not apply to system (14.51) due to the presence of the 
nonlocal term. For this reason, in the present appendix we state the results, recalling only 
the main steps of their proofs, since they are very similar to those of Proposition 3.3 and 
Theorem 3.1 in [6j. 

A.l Maximal solution to BSDE (I4.10D - (I4.11I) 

We begin addressing the problem of existence and uniqueness of the maximal solution (see 
Definition 14.11) to the BSDE with partially nonnegative jumps on infinite horizon (14.101) - 
(14.111) . Concerning uniqueness, we have the following result. 

Lemma A.l Suppose that Assumption (HI) holds. Then, for any (3 > 0, n £ N, (x, i , u ) £ 
R rf x I m x U, there exists at most one maximal solution to equation (14. 101) - (14. 11 1) . 

Proof. The uniqueness of the Y component follows by definition. Now, consider two 
maximal solutions (Y , Z , L, R, K), (Y, Z' , L\ R' , K ') in S^ c x Lp oc (W) x L 1 2 oc (7t) x L 1 2 oc (/2) x 
Kj^ c to (14. 101) - (14. 111) . Taking their difference, and identifying the Brownian and finite 
variation parts, we see that Z = Z' . Afterwards, recalling that the marked point processes 
associated to it and p, have disjoint (due to the independence of it and p) totally inaccessible 
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jumps, while K and K' have predictable jumps, we conclude that L = L' and R = R ', so 
that K = K'. For more details, we refer to Remark 3.1 in [6j. □ 

The existence of the maximal solution to (I4.10l) - (ld.lll) is based on a penalization method. 
More precisely, for any (3 > 0, n, k £ N, and (x, i, u ) £ M. d x I m x U, consider the following 
doubly indexed penalized backward stochastic differential equation on infinite horizon: 


-y(3,n,k 

Y t 


pi pi 171 pT 

Yp n ’ k -/3 Y^’ n,k ds + / f{Xf’ u ,llT u s )ds-Y, L^ k (j)ds (A.l) 
Jt Jt j =1 Jt 

m ,T ,-T /• 

+ nJ2 [Ls’ n,k (j) ~ c{Xg ,i,u , P s -, j)] + ds ~k / [R^ k (u')]~ d,{du')ds 

Jt Jt Ju 

- [ zP’ n ’ k dW s - [ [ L^ n ’ k {j)n(ds,dj) - [ [ RP’ n ’ k (u')fl{ds,du'), 

J t J t J I m J t J U 


for any 0 < t < T, T £ [0, oo), where h = — nrin(/i,0) denotes the negative part of the 
function h. Then, we have the following result. 


Lemma A. 2 Let Assumptions (HI) and (H2) hold. Then, for any (3 > 0, n, k £ N, 
(x, i, u ) £ x I m x U, there exists a solution (yh,n,k,x,i,u^ % p,n,k,x,i,u ^ ,n,k,x,i,u , j^p,n,k,x,i,uj 


e S L x 


Lf„e(W) x L 1 2 oc (7t) x L f oc (ja) to (IA.1D such that 


I Trfi,n,k,x,i,u 

I Y t 


< 


Cb,a,f 

P 


(1 + 


xU u \), 


Vt > 0, 


(A.2) 


where is a positive constant, depending only on b,a,f. This latter solution is unique 

among all quadruplets (Y, Z,L,R) £ Sj^ c x P„c( w > x L^ c (7t) x Lj^ c (/2) such that, for some 
constant C > 0 (possibly depending on (3, n, k, x, i,u), we have \Y t \ < C(1 + \Xf ' l ' j), for all 
t > 0. 


Proof. The result follows from the same arguments as in the proof of Proposition 3.1 in 
[6]. Here, we give simply a sketch of the proof. 

Uniqueness. Consider two solutions (Y , Z , L , R), (Y', Z', L', R’) to (1A.1I) . satisfying a linear 
growth condition as stated in Lemma fA.21 and apply Ito formula to the difference e~ 2 P s \Y s — 
Yf | 2 between s = t > 0 and s = T > t. Then, from the resulting expression we see that 
there exists ^ £ Ek such that, taking the expectation E 1 ^ with respect to P 1 ^ (we denote 
by P 1 ’^ the probability measure P 1 ^ with v = 1), we obtain 

E 1 ’* [| Y t - Yt | 2 ] < [| Y t - Yf | 2 ]. 

Then, using the growth condition of YT,Yf together with estimate (14.91) . we see that Y — 
Y' = 0. Finally, since Y = Y', the identities Z = Z' , L = L' , R = R' can be proved 
proceeding as in Lemma lA.il 

Existence. The proof consists in approximating equation (1A.1D through a sequence of 
BSDEs with finite time horizon and zero terminal condition. More precisely, for any T > 0 
and ( x,i,u ) £ x I m x U , we consider the following backward stochastic differential 
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equation on [0, T]: 


Y. 


/• 1 r I r I 

T,p,n,k = _p Y J^ k ds+ f(X^,li,T u s )ds-y2 L T s ^ n ' k (j)ds (A.3) 

Jt Jt • =1 Jt 

m pT r-T /■ 

+ n]T/ [L^’ n ’ k (j)-c(Xf’ u ,P s -,j)] + ds-k / [R T s ^ k (u')Yd,(du')ds 

■ =1 Jt Jt Ju 

- f T Zj-^ k dW s - f [ lTM(f)n(ds,df) - [ T [ R T s ^ k (u')p(ds,du'), 

J t J t J I m J t J u 

for any 0 < t < T. From Lemma 2.4 in [231 we know that there exists a unique solution 

(YT,P,n,k,x,i,u, Z T,p,n,k,x,i,u^ jT,f),n,k,x,i,u^ R T,P,n,k,x,i,uj G S 2 X L 2 (W) X L 2 (jf) X L 2 (/I) to 

equation (1A.3I) . Proceeding as in Proposition 3.1 in [6], we then exploit Girsanov’s theorem 

m m/ m rr"t/ m rTi/ m rri/ 

to investigate the differences y — Y" , Z — Z , L — L ,U — U . In particular, we 
are able to determine opportune estimates for those differences, which allow to pass to the 
limit as T —> oo in equation (1A.3I) and to end up with the solution to (1A.ll) . □ 


We can now state the following existence and uniqueness result for the BSDE with 
partially nonnegative jumps on infinite horizon (14.10p ~ (14.1 1 D . which in particular proves 
statement (i) of Proposition 14.21 


Proposition A.l Let Assumptions (HI) and (H2) hold. Then, for any f3 > 0, n <E N, 
(x, i, u) € x I m x U, there exists a unique maximal solution (yh,n,x,i,u^ ^/3,n,x,i,u^ 
R p,n<c,i,u ]K f),n,x,i,u) G gjj^ x L 2 c (W) x L 2 ^) x L 2 c (/2) x K 2 C to gH - (ED such that: 


(i) For all t > 0, Y t 


f3,n,k,x,i,u 


Y 


p,n,x,i,u p_ a _ g _^ as k —y oo. 


(ii) For all T > 0, (Zff’Jj 


B.n.k.x.i.u T B.n.k.x.i.u nB,n,k,x,i,u\ , 7 / 77 \ 

Lu rn^i ’^iroT] ) k str °ngly [resp. weakly) converges 


3,T] 


to (Z^ n jf ] ’ l ’ u , R^^ l,u ) in (W) x L£(7 t) x L£(/!), for any p € [1,2) (resp. 

in L 2 (W) x L£(7 t) x L 2 (ft)). 


(iii) For all t > 0, (K^ ,n,k,x,l ’ u ) k weakly converges to K^’ n,x,l,u in L 2 (J4, J),P). 


Proof. The proof can be done proceeding as in Proposition 3.3 in [6]. We just recall the 
main steps. Firstly, for all t > 0, the nonincreasing property of the sequence {Y^ ,ri)k ’ x ’ l ’ u ) k 
follows from the comparison theorem for BSDEs with jumps, see, e.g., Theorem 4.2 in m- 
The monotonicity property provides the existence of a limiting adapted process Y^ ,n,x,i,u 
satisfying estimate (1A.2[) . Afterwards, for any T > 0, we consider equation (I4.10I) - (I4.11D 
on [0,T] with terminal condition Y^’ n,x,l ’ u . Then, from Theorem 2.1 in [T7] it follows that 
there exists a unique maximal solution to (14.10[) - (I4.11[) (Theorem 2.1 in |17] applies to 
minimal solutions; however, simply notice that if Y is a maximal solution to (14.10D - (14. IIP , 
then — Y is a minimal solution to a certain BSDE with partially nonpositive jumps to which 
Theorem 2.1 can be applied), for which the convergence results (i)-(ii)-(iii) of Proposition 
IA.II hold on [0,T]. Even though the maximal solution to (14. 101) - (14. Ill) on [0, T] can a priori 
depends on T, this is not the case due to the convergences (i)-(ii)-(iii) on [0, T], which call 
in the penalized BSDE (IA.1I) . whose solution does not depend on T. As a consequence, 
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we can past together all these maximal solutions on [0, T\, for any T > 0, and we end up 
with a maximal solution to equation (14.10l) - (14.11l) on [0, oo). Finally, the uniqueness of the 
maximal solution follows from Lemma lA.il □ 


A.2 Feynman-Kac formula for V^ ,n 

We now derive, by means of the doubly indexed penalized BSDE (lA.ip . the Feynman-Kac 
formula for V^' n and study its viscosity properties. To this end, for any fi > 0, n, k £ N, 
we define the function V^ ,n,k : M. d x I m x U —> M as follows 

V^ n ’ k (x,i,u) = yg' n ’ k ' x ' i ' u , V (x, i, u) el rf xl m xU. (A.4) 

Then, V^ n ’ k is associated to the following elliptic integro-PDE: 

/3VP’ n ’ k (x, i, u) - C' u V^ n ' k (x, i,u)- I [vP’ n ’ k {x, i, v!) - vP' n ’ k {x , i, u)l Q^du') 

Ju 

m 

-f(x,i,u ) [vP’ n ’ k {x,j,u) - V^’ n ’ k (x,i,u) - c(x,i, j)] + (A.5) 

3 = 1 

+k [ [V^’ n,k (x, i, u') — V^ ,n,k (x, i, u)] = 0, 

Ju 

for any (x, i, u) £ x I m x U. More precisely, we have the following result. 

Lemma A.3 Let Assumptions (HI) and (H2) hold. Then, for any (3 > 0, n,k £ N, the 
function V^ ,n,k defined in (1A.4D is a continuous viscosity solution to (1A.5I) satisfying 

\vP’ n,k (x,i,u)\ < ^l(l + \ x \), V (x, i, u) £ R d x I m x U, (A.6) 

where Cb, a ,f is the same constant as in estimate (1A.2I) . 

Proof. The proof is standard and can be done along the same lines as in the proof of 
Proposition 3.2 in [6]. □ 

We can finally state the main result of this appendix, namely the Feynman-Kac formula 
for V ld ’ n , which proves statement (ii) of Proposition 14.21 

Proposition A.2 Let Assumptions (HI), (H2) , and (HU) hold. Then, for any (3 > 0, 
n £ N, (x,i) £ x \ m , u £ U, the random variable Y^’ n ’ x,t ’ u is equal P-a.s. to a constant 
independent of u £ U. Moreover, the function V^ ,n : M. d given by 

V^ n (x,i) = Y$' n ' x ' i ' u , V(x,i)£l rf xl m , 

for any u £ U, is a continuous viscosity solution to system (14.51) and satisfies 

sup 

(a;,i)eR d xI m 


\VP’ n (x,i)\ 
1 + \x\ 


< oo. 


(A.7) 
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Proof. The proof can be done as in [6], Theorem 3.1. Here, we recall the main steps. 
Firstly, for any T > 0, (3 > 0, n, k G N, we consider the following parabolic integro-PDE on 
[0, T] x R m x I m x U in the unknown w: [0, T] x x I m x U —> R: 


C i,u w 
d t 


— / [w(t, x, i, u!) — w(t, x, i, u)] 'd^du') 

Ju 


-f(x,i,u) -n^2 [w(t , x, j, u ) - w{t, x, i, u) - c(x, i, j)] + 
+k [ [w(t,x,i,u')~ w(t,X, i ,«)] 


(A.8) 


= 0 , 


' u 


with terminal condition w(T,x,i,u) = V^ ,n,k (x, i, u), \/(x,i,u ) G M. d x I m x U. Since the 
coefficients of system (|A.8[) are constant with respect to time t. we see that V^ ,n,k solves 
(IA.8D in the viscosity sense. Then, we can aDDlv Theorem 3.1 in m to conclude that 
the limit Hindoo V r/3,n,fc (x, i, u) = \imi e ^. 00 YQ ,n ’ k,x ’ l ' u = Y^ ,n " L, ' l,u does not depend on u in 
the interior U of U. Notice that Theorem 3.1 in mi applies to equations with “sup, ief/ ” 
instead of “inf ue [/” as in (14.511 : however, simply observe that if V^’ n is a viscosity solution 
to system USD, then —V^' n solves a system with “sup ugt /” in place of “inf u eu”, f° r which 
we can use the results of Theorem 3.1 in Em- 

The continuity of the function V^ ,n is a consequence of estimate (|4.23|1 . which can be 
proved without relying on the (not yet proven) viscosity properties of V ^' n , but proceeding 
as in Corollary 14.21 where we used the dual representation formula (|4.12l) . Moreover, from 
the monotone convergence of (V^ ,n,k )k towards V^' n as k —>• oo, together with estimate 
(1A.6I) . we deduce the linear growth condition (|A.7I) of V^' n . 

Finally, thanks again to Theorem 3.1 in im, we have that, for any T > 0, the function 
VP’ n is a viscosity solution to the system of parabolic PDEs on [0, T] x 
unknown w: [0, T] x W d x I m —> R: 


x in the 


dw 


m 


/3w- — ~ inf [C’ u w + f{x, i, u)\ - n \ [w{t, x, j) - w(t, x, i ) - c(x, i, j )] = 0, (A.9) 


3 =1 


with terminal condition w(T, x, i ) = V 8 ’ n {x, i), V (x, i) G x I m . Since system (IA.9H holds 
for every T > 0, and V^ ,n is constant with respect to time, it follows that V^' n is indeed a 
viscosity solution to (14.51) . □ 
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